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We Are a PC Shop That 
Recently Added Console. 








Some of this talk may seem elementary 
to console-exclusive developers... 

... but each one ofthese issues has 
burned an actual project. 

Experienced console devs will still find 
useful info here. 
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This Isa High-Level Talk 
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This Talk is Based On: 



• Ourwork at Valve 

• My work elsewhere 

• Interviews with others throughout 
industry 
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What LandminesAwait A PC 
DeveloperGoing To Console? 
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Consolesare like PCs.. 
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A PC 

Closed Platform 
ManufacturerQA 
Limited Memory 
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Common Problemsof 
Crossplatform Development 


• Developer Efficiency 

• Certification Failure 

• User Experience 

• Programming Issues 
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Targeting Console is Similar 
to Targeting a Minspec PC 

• Valve a Iways tie ns our PC experience 

High-end (Shader Model 3) 



Midrange (ShaderModel 2) 
Low-end (DirectX 8) 
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Now We Know Where The 
MinesAre... 
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Common Problemsof 
Crossplatform Development 


• Developer Efficiency 

• staff allocation 

• Trouble Iterating 


• Certification Failure 

• User Experience 

• Programming Issues 


CMP 


VALVE 


WWW.GDCONF.COM 


Umtuil Buspncib Mctlu 


The Cote Team 


jQa nie Developersr 

enc© pp^ 

© 


The Console Person 

Your most experienced programmer. 

Understands the entire codebase. 

Seniorenough to affect schedule. 

Gets the game running forthe first 
time. 

Becomes an oracle by project end. 
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The Cote Team 
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The ICR (Tfechnical Certification Requirements) 

Expert 

Producer, Programmer, orQA. 

Lea ms every item on Micro so ft/ Sony's 
c e rtific a tio n c hec klist. 

Builds test cases. 

ICR is not a job for one programmer. 

• Does need one person in change. 
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The Cote Team 
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• The DevkitGuv 

• Gets people up and running. 

• Sets up artists to look at their levels, 

• Gets prog rammers set up with their 
debugger. 

• Isn't a full time job, but can be a major 
distraction. 

• Doesn't need to be a lead. 
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Common problems of cross 
platform development 







• Developer Efficiency 

• staff allocation 

• Trouble Iterating 

• Certification Failure 

• User Experience 

• Programming Issues 
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Problem: Iteration is slow. 



• Iterating on PC : 


• Iterating on Devkit: 
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Keep your PC version 
working. 


• Debug and load times always faster 
on PC than console. 

• Runtime iteration much easier on PC 

• Edit & continue 

• Reloading assets 

• Compiling slower for console target 


•• 


•• 
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Simulate console content 
features on PC 


• PC workflow is more comfortable for 
artists 

• PCsane cheaper than devkits 

• Encourages experimentation 
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C ro S5 p la tfo mn assets 



• Consoles have their own formats. 

• Do you byte swap on load? 

• Consoles prefer assets comp lied into 
big files. 

• PCs have disk caches 
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The Catch-22 



Load asset files 
individually: 

® launch times longer 

® Changing data faster 
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Compile paks: 

® code changesfaster 
® data changesslower 
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Our hybrid solution: 


• Compile asset tree into 
pa ks nightly. 

• Artists specify individual 
assets to override locally 

• Best of both worlds 
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Branch In Pipeline, 
Not In Source 


• You will need to 
recompile every asset 

• Try not to diverge assets 

• Make tools deal with 
platform differences, 
instead of artists. 

• Keep the source a It for 
everything. 
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Common problems of cross 
platform development 


• Developer Efficiency 

• Certification Failure 

• OutOfMemory 

• Starting Too Late 

• Multiplayer 




User Experience 
Programming Issues 
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Technical Certification Requirements/ 
Technical Requirement Checklist/ 
CERT 


• Ihe process by which 
console manufacturer 
ensures quality. 

• A specific list of 
requirements that your 
game must meet. 

• Pass, or do n't ship. 
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Most Common Problems: 



• Stability 

• Ul - very specific requirements 

• Savegames 

• Need to be completable with no save 
media 

• Online / UVE 



•• 
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Problem: 

Game RunsOut Of Memory. 



Console: 
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• Memory is critic ally strict. 

• The #1 reason levels get changed. 

• The lateryou wait, the more drastic the 
cuts. 

• You will alwayswish you had worried 
about memory sooner. 

• Account foreve/yth/ng. 
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Dynamic Allocation Is Bad. 


• If you don't know how much memory 
you're going to need, you don't 
know if you're going to run out. 

• PC games tend to allocate memory 
ad-hoc. 

• Keep track of where it goes 
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Where Does Memory Go? 
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Executable code 

• Does not change at runtime. 

Assets 

• Textures, level geometry, models, 
animations, sound, sprites, ... 

• Loaded into memory from disk. 

Heap 

• Data generated at runtime by code. 

• Anything that is not assets. 
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Assets Have Grown Faster 
Than Heap. 


Half-Life 2 Memoiy Use 


384 


128 

0 


XBOXl XBOX 360 


A y 

7 





□ Assets 




□ Heap 




■ Code 


V# Vi- 
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Squeezing assets, Step 1: 
Account. 


• Track every asset allocated. 

• Emit spread sheets for each level. 

• Automate this process. 

• Do it every night. 

• Will highlight all serious problems... 

• ...and make new ones obvious. 
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Squeezing assets, step 2: 
Compress. 


• Use platform-specific formats. 

• XMA, AAC have good ratios 

• Leverage yourshaders' and SPU's 
power 

• Comp ness norma I maps, grayscale 
textures, animations... 

• May need to split up textures 


•• 
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CMP 


Squeezing assets, step 3: 
Reduce. 

• Budget your 
textures/ models 
/ meshes 
carefully. 

• It'seasy to just 
downsample all 
your textures... 

• Butyoucanget 
much better 
results with careful 
targeting. 
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Squeezing textures 

• 20% of the textures a re 80% of the problem. 

• Source hastoolsto show us i/i/h/ch 20% 
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Squeezing textures 


• Halving one 1024x1024 texture saves as much 
memory aseliminating 32 128x128' s. 

• Focuson what's actually visible, so you can 
reduce where no one will notice. 




Squeezing assets, step 4: 
Maintain. 


• Staying in memory is everyone's job. 

• Know exactly when and where 
regnessionsoccur. 

• Find exactly which change to blame. 
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Squeezing assets, step 5: 
Panic. 


• If a II e Ise fa ils. . . sp lit le ve Is. 

• Remove characters. 

• Decimate textures. 

• Downsample animation. 

• Dealing with memory soonerwill 
spare you all these painful measures. 
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Memory would be allocated at load 
time... 


or vV ^ 
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Code 

Geometry 

Textures 

Sound 
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Entities 
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Managing Heap Growth 
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• Many games load assets ad hoc 

• Textures, models, animations, sound 

• Code generatesdata too 

• Spawning entities, particle systems, Al 
state... 

• Crashes most likely in level loads 


•• 
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mallocO Considered Harmful 

( new/ delete too ) 


• Game play systems mo St likely source 
of leaks. 

• Good containerc lasses provide 
easier management, less leakage. 

• Only if you write yourown allocator! 
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WHYTO: Make A Custom 
Memory Allocator 


• Replace mallocO, callocO, new, etc. 
with yourown code. 

• Better than STUDIO NEW, 

STUDIO DELETE ma c nos: 



CMP 


• No big search and replace. 

• You can't fix a II the new/deletes in 3d 
party libraries... 

• ... so linkthem to yourown allocator. 
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HOWTD: Make A Custom 
Memory Allocator 


• Override every function in the CRT.objthat 
containsmalloc: 

• ma Hoc, free, c a Hoc, realloc... 

• Put your implementation in its own .cpp 

• Unkthis .cpp to every project in yourgame. 

• Only works if you override the whole 
module... 

• ... so you need to re-do this if you change 
compilers or CRTs. 
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pwn your memory 
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• If you own every allocation, you can track 
every allocation. 

• Even those coming from the STL 

• Write global fixed -size pool allocators. 

• Unnit fra gnnentation. 

• Look up the lianslation Lookaside Bufler. 


•• m* 
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Track Memory Based On 
Exactly Who Allocates It 


• Budget asset allocation by type 

• Texture, geometry, sound... 

• Budget code allocation by purpose 

• AI::Navmesh, Particles, Rendertarget... 

• A/otstd::vector<int> 
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Track Memory Based On 
Exactly Who Allocates It 



CMP 


Thingy *WasteMemory( Thingy* input, 
std : : vector<Thingy> &list ) 

{ 

MEM_ALLOC_CREDIT ( IMPORTANT_SYSTEM ) ; 
globalSystemList . AddToTail(input ) ; 
list . append ( *input ) ; 

Thingy *output = new Thingy; 
output = DeepCopy(input ) ; 
return output; 

} 
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Be Careful With Coritainers 



• Container classes mean more: 

• Dynamic allocation 

• Range checking 

• Copying things a round 

• Use std::vec tor:: re serve 
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We Do This Work For PC Too 
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• Diskswapping bad! 

• Bud get tracking means reliable 
information everywhere. 

• Retrofitting later means touching a 
thousand different places. 
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Common problems of cross 
platform development 


• Developer Efficiency 

• Certification Failure 


•• •» 
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Out Of Memory 
Starting Too Late 


CIVIP 
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• Multiplayer 


• User Experience 


• Programming Issues 
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other Interesting ICRs 
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• Load times no more than X seconds 

• Letting people play their MP3 
collection in yourgame. 

• Minimum refresh interval... even while 
loading. 

• Compiled with recent SDK. 
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Solve It In Design 



• Make cert requirements part of your 
architecture. 

• Ihink a bout Achievements/ Skiii Points in 
yourdesign. 

• (you can get them on PC with SteamWorks) 
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Savegames 
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• Use sma II ind ivid ua I files, not o ne 
large package 

• Fits on memory cards. 

• Deal with losing memory card during 
save. 

• Do you really need save-anywhere? 

• If you rely on quicksave, 

• pneallocate a RAM disk big enough. 


•• 
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• Consider title -safe and widescreen 

• Be readable in 4:3 SD and 16:9 720p. 

• Be readable in 4:3 SD... /n Gernian. 

• ICR has specific requirementsforUI layout & 
flow: 

• Need a way to pop dialogson top 

• Manufacturer-approved graphics, names 

• This usability work makes your PC game 
better. 
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Common problemsof 
c ro ssp la tfo rm development 


• Developer Efficiency 

• Certification Failure 


• OutOfMemory 

• Starting Too Late 

• Multiplayer 

• User Experience 

• Programming Issues 
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Multiplayer/ UVE 
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Wasthe majority of ourcert issues 

Start working on this from day #1. 

• Do your preliminary work in sample a pps 

• Do not let it be blocked by engine 
development. 

Rich presence may require 
architecture changes 

Enlist Microsoft/ Sony's help. 

• They have lotsofgood tooisforyou. 
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M u Itip la ye r Te sting 
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• Your office LAN is not the Internet. 

• Debugging without encryption, voice hides 
problems. 

• Some problems a rise only with high load. 

• Do a beta if you can. 

• Latency, bandwidth, ping, problemsas 
always... 
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MultiplayerTesting: Simulate 
YourOwn Network Backbone. 




Courtesy Ben Stragnell 
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Common problemsof 
c ro ssp la tfo rm development 


• Developer Efficiency 

• Certification Failure 

• User Experience 

• Load limes 

• Use of multicone 

• Controls 

• Programming Issues 


VALVE 


WWW.GDCONF.COM 



Problem: Game TakesToo 
Long To Load. 


*4 
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Optical Load Times 
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PROBIEM 

soiunoN 

Seeks 

Contiguous files, careful 
la yo ut 

Misaligned reads 

Sector alignment 

Buffered access 

Unbuffered DMA I/O 

Synchronous stalls 

Async hronous loa d ing 

Small filesloaded on 
demand 

Large, single files 
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ThingsThat Make A DVD 
Load Faster 


• .ZIP files 


• Compression 

• (trade CPU for I/O bandwidth) 

• Asynchronous loads in a separate thread 


•• 

•• 
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How We Refit Our Game 
Without Rewriting Everything 



Game Thread 



RESOURCE ABSTRACTION 



A 


OS FILESYSTEM 


RAM disk 
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DVD 


I 

HDD 
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Three Categories Of Data 


jQa nie Developersr 

enc© 

© 


• Big 

• Textures, models, BSP, sprites, SFX 

• Small 

• Config files, scripts, <4koddsand ends 

• Really Big 

• Dialog, long animations 

• Stuff you don't need rightaway 
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Synchronous (naive) loading 



.4 *. 

t: 
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Asynchronous loading 








Key features 
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• I/O thread does unbuffered DMA 
transfers. 

• Keepsthe 6\^ spinning continuously. 

• Log kless implementation 

• Trade CPU/SPU for I/O bandwidth 

• Return dummy values to sync loads. 
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Really big files: streaming 


jQa nie Developersr 

enc© 

© 


• Store the first V2 sec of each 
animation and audio always 

• Asynchronously load the rest in the 
background 

• Need a resource abstraction layer 
that can say: 

• We have the data 

• We're getting the data 

• We will never get the data 
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Sma II files 

• Pnecompile all small ad-hoc files into one 
large blob 

• Read it in one operation with level 

• Create a fake file system 

• Don't have to change game code! 


CMP 
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Know In Advance Each 
Level's Resource Needs 


• If you're going to build a pak, you 
need to know what goes in it. 

• Every single asset. 

• Analyze loading dependencies. 

• Crash when loading out-of-pa k. 


mm 

mm 


mm 

mm 
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Common problems of cross 
platform development 


• Developer Efficiency 

• Certification Failure 

• User Experience 

• Load limes 

• Use of multicone 

• Controls 

• Programming Issues 
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Going Multithreaded: 

It's not next-gen any more 



Xenon 



Cell 




AMD Barcelona 



I RenametAlloc 


: Reorder Buffer 
Retirement Unit 


Reorder Buffer 
Retirement Unit' 


Schedulers 


Schedulers 


LI 0-Cache and D-TLB 


System Bus 


instruction Fetch 
and PreDecode ' 
♦ 

llnstruction Queue' 

I 


Rename/Alloc ' 

i 


Jlnstruction Fetch! 

\ and PreDecode I 

i 

Instruction Queue] 

I Decode ^ 


Intel Cone 2 









All MajorPlatformsAre 
Multicone. 


• 360: 3 symmetric PowerPC cones, 6 
threads 


• PS3: 1 PowerPC, 2 threads; 7 vector 
processors 

• Intel/AMD: Qua dc ore now, 8-core 
tomorrow 


mm 

mm 


mm 

mm 
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• This is not "next gen", it is "today." 


VALVE 




WWW.GDCONF.COM 



Ourtechnique: 
Discussed here before 


"Dragged Kicking and Screaming: 
Source Multicore" 

Tom Leonard (Valve), GDC 2007 


http ://www.va Iveso ftware.com/publications.html 


mm 

mm 


mm 
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queues: a summary 


Job 


Code 


Data 


® A job is code and local data 

® Put into a queue; otherthneads 
consume from queue 


«• 

• • •• 
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Worked BetterThanWe 
Expected! 


• O n the 360: 

• 50%performance improvement justfrom 
queuing graphics functions 

• 4x increase in fra me rate with full 
implementation. 

• On the PS3: 

• Game wouldn't run othen/vise! 

• Our game already had a client/server 
split. 


•• 

•• 


•• 
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De-G lobalize Your Data 
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• Pack jobs' data up so they work 
locally. 

• Put global data into a closure. 

• Avoid chasing pointers a II over 
memory. 

• Especially critical on PS3. 

• SPUs have only 256kb of memory. 

• Random memory accessishuge stall. 


•• 
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PS3 Requires More 
Aggressive Threading 


• All the power of the PS3 is in its Cells. 

• The PPU will be always saturated. 

• General C-H-code does not run well 
on SPUs. 

• Code memory is tight. 


mm 

mm 


mm 

mm 
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Some ThingsTo Worry About 
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• Callbacks 

• Synchronizing simulation clocks 

• Mutexes (can make you slower than 
singlethreaded) 

• Hardware threads useful only in 
certain cases- measure it. 
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Common problems of cross 
platform development 


• Developer Efficiency 

• Certification Failure 

• User Experience 

• Load limes 

• Use of multicone 

• Controls 

• Programming Issues 
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Problem: 

controls don't feel right. 


• Have PC de vs test 
with 360/ PS3 
controllers. 

• Yes, you can connect 
them to a PC. 

• Makes everyone a 
usability tester a II the 
time. 

• PS3, 360 have 

d ifferent thumbstic k 
calibrations. 
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Common problems of cross 
platform development 


• Developer Efficiency 

• Certification Failure 

• User Experience 

• Programming Issues 

• Graphics 

• Fiameiate / CPU 
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Time ForGood Graphics! 


*4 •• 

•• •• 
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TV pixel and colorspaces 
dlfferfrom monitors 
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Wsnebalance histograms 
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Channel: | RGB ^ 



Mean: 

10.49 

Level: 

Std Dev: 

13.38 

Count: 

Median: 

6 

Percentte: 

Pixels: 

230400 

Cache Level: 2 



Mean: 

43.19 

Level: 

Std Dev: 

35.22 

Count: 

Median: 

32 

Percentte: 

Pixels: 

230400 

Cache Level: 2 
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TVs vary in quality 

• A common office fight: 


• Lookgood on a default-settings TV? 

• Orone that'sbeen calibrated? 


• TV defa u It settings vary very widely. 

• The solution: 
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Watch W AtThe Office. 



• Watch television on 
the displays you 're 
developing with. 

• Calibrate your W 
so TV looksgood. 

• Don't buy the same 
TV for everyone! 
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Shaders 
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• PC uses HLSL Consoles use HL5L. Done. 

• Shaderconnpilers may be a bit different. 

• The few problems will be with the most 
complicated shader. 

• GPU/CPU powerbalance a little different. 

• Shaderconditionalsperfomn well! 

• We distribute ourshadercompiles. 

• Compile each shaderforboth platforms before 
checkin. 

• Compile everything offline nightly for regression 
testing. 



CMP 

(Jiiitt’d Busincib McJij 


VALVE 


WWW.GDCONF.COM 


sRGB 



• sRGB re ad /write curve 
d iffe re nt 0 n 360. 

• Keep yoursource art 

• Compiling from 
anotherspace loses 
precision. 

• See Alex Via chos' talk: 
"Post Processing In 
The Orange Box", 

Feb 18, 2008. 

http ://www.va lvesoftware.com/ 
publicationshtml 
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PC Gamma to Linear 


sRGB Write 



Linear to PC Gamma 


sRGB Read 



360 Gamma to Linear 


sRGB Write 



Linear to 360 Gamma 
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other notes: 
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• PIX/ GCM Hud excellent for very 
specific, actionable info. 

• Look into tiled rendering on 360 

• Makes antialiasing easier, but isn't critical. 

• If you're hung up on getting PC and 
console to match perfectly... let go. 

• No one is playing your game twice 
simultaneously side-by-side. 

• It just hasto lookgood. 
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Common problemsof 
c ro ssp la tfo rm development 


• Developer Efficiency 

• Certification Failure 

• User Experience 

• Programming Issues 

• Graphics 

• Frameiate / CPU 


•• •• 

•• •• 
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360, PS3 have in-order 
PowerPC CPUs. 


• Iheydo not rearrange instructions to eliminate 
dependencies. 

• Sloppy code runs more slowly. 

• Why? Reordercincuitry iscostly, takesup space... 

• ...space now used for additional entire cores! 
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In-order PPCs run sloppy 
code more slowly than x86 


• 25%-50% sp e e d fo r stra ig ht c no ss- 
compiled code. 

• Careful optimization gets close to parity. 

• SIMD a bigger win on PPC than x86. 

• Rememben on 360 you have three of 
them. 
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LfARN THE ASSEMBLY 
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Sometimes you still have to do this. 

Use intrinsic s, understand what they 
are doing. 

Helpsdebug release-build creshes 

• Learn the calling convention, 
how to augurcrash dumps 

Double-check what comp Her emits. 
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LEARN THE PIPEUNE 
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• PPCsane high-latency, high- 
throughput 

• Learn about all the hazards 

• Registerdependency, load -hit-store, 
cache miss, microcode, ERAT, 'TLB... 

• Understand whatthe profiler is telling you. 

• 80% of perf from touching 20% of code. 
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Actually Use SIMD 
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Abstract interface 
for a II platforms. 

Push native vector 
class everywhere. 

Replace doubles 
with floats 


FORCEINLINE Vector Add { const Vector & a, 

const Vector & b ) 

{ 

#ifdef _X360 

return vaddfp{ a, b ) ; 

#elif defined (_SSE) 

return _mm_add_ps { a, b ) ; 

#else 

return Vector{ a.x + b.x, a.y + b.y, 

a.z + b.z, a.w + b.w ) ; 

#endif 

} 
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#ifdef Is Not The Way To Go 

• Compilerswill elide code in an if() 
block that is always false. 


#define IsX360() true 
#define IsPC() false 



CMP 


void DoStuffO 

{ 

if ( ISX360O ) 

{ 

PlatformSpecificFunction( ) ; 

} 

else if ( IsPC() ) 

{ 

WindowsSpecificFunction( ) ; 

} 

else 

{ // you might be on the Wii one day! 

GeneralCaseFunction( ) ; // or throw an assert 

} 
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Use if() Instead of #ifdef. 



• Stops "the PC guys broke the PS3 build 
again!" 

• You may need stub functions 

• Don't assume "if" PC "else" 360. You 
might be on PS3 or Wii one day. 
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Not All Optimization Is 
Premature 


• Don't "do a big perf passatthe end". 

• Getting from Sfpsto 15fps isn't 
optimization, it's a key feature. 

• Have budgets from the start, 

• Have tools to stay inside them. 



•• 
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Things you need to buy: 
Devkits 


• Development kits 

• Live debugging 

• Engine, system prog rammers - 
anyone whose bugsbiock 
someone else 

• Test kits 

• Printf debugging. 

• Artists, QA, maybe gameplay 
programmers. 

• Prepare forfailure rate. 


Cost: 



Cost: 
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O the r Sug g estio ns 


• For your first title: keep it simple! 

• Keep people on kits. 

• Work to the most constrained 
platform. 
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Measure Everything 



• Measure everything yourself, as often 
asyou can. 

• Take nothing for granted. 

• Verify your compiler output. 
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Recap 
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• Make cert part of yourdesign. 

• Memory will always be a struggle. 

• Automate offline testing. 

• Regression Isa bigger problem in cross- 
platform development. 

• Keep the PC version working! 


• Most importantly... 
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DO ITNOW 
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• Ihe so oner you start, 
the better off you 
will be. 

• Manufacturing lead 
timesare longeron 
console, and you 
ha ve IRC . 


CMP 


VALVE 


UmlcJ McUij 



WWW.GDCONF.COM 


The Terrible SectetOf CtDss- 
Platform Development: 
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AIIThisWill Make Your PC 
Title Better! 


• TRC is just a group of good usability rules. 

• Memory efficiency helped uson every 
platform. 

• PC games deserve shorter load times. 

• Making money on the PC means hitting the 
low end. 

• If it runs well on console, it'seasy to make it 
run well on PC. 

• Steamworkseven letsyou have achievements 
and updates! 


•4 
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Spec ia ITha nks 


• lestyn Bleasdale-Shepherd 

• Steve Bond 

• Kerry Davis 

• Vitaliy Genkin 

• Brian J acobsen 

• Tom Leonard 

• J ason Mitchell 

• Aaron Seeler 

• JayStelley 

• AlexVIachos 

• JoshWeier 

• (and everyone at Valve) 
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Questions? 
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